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Abstract 

This paper gives a new solution to the output feedback H2 model 
matching problem for a large class of delayed information sharing pat- 
terns. Existing methods for such problems typically reduce the decen- 
tralized problem to a centralized problem of higher state dimension. In 
contrast, the controller given in this paper is constructed from the solu- 
tions to the centralized control and estimation Riccati equations for the 
original system. The problem is solved by decomposing the controller into 
two components. One is centralized, but delayed, while the other is de- 
centralized with finite impulse response (FIR). It is then shown that the 
optimal controller can be constructed through a combination of central- 
ized spectral factorization and quadratic programming. 

1 Introduction 

Decentralized control problems arise when inputs to a dynamic system are cho- 
sen by multiple controllers with access to different information. In decentralized 
control with delays, local measurements are passed to the various controllers 
over a communication network with delays. As a result of the delays, some 
controllers will have access to measurements before others. This paper provides 
a new solution to the H2 model matching problem, subject to communication 
delays, based on spectral factorization. 

1.1 Related Work 

A large number of dynamic programming methods have been developed for 
decentralized optimal control problems. For the special case known as the one- 
step delay information sharing pattern, the output feedback W 2 problem was 
solved in the 1970s by dynamic programming [3 [31 [3] . For more complex delay 
patterns, dynamic programming has extensions to decentralized state feedback 
[H El E] , but output feedback is difficult because the separation principle fails 
[3 0(9]. Recently, methods based on POMDPs have been developed for output 
feedback control of nonlinear systems with general delay patterns [101 lllj . 



In the past few years, spectral factorization has been employed to derive 
explicit solutions to the H2 problem with sparsity constraints, but not delays. 
First, decentralized state feedback was addressed [THUS], followed by restricted 
types of output feedback [TH [13] , and most recently full output feedback jH] . 
In these works, it was shown how to efficiently construct decentralized solutions 
using standard Riccati equations. This paper applies spectral factorization to 
delayed information sharing patterns. As in the sparsity constrained case, the 
resulting controllers are efficiently computable from solutions to centralized Ric- 
cati equations. 

1.2 Existing Solutions 

The output feedback H 2 problem with communication delays, as studied in this 
paper, has been previously solved using approaches based on vectorization [T7] , 
linear matrix inequalities (LMIs) [TH1 [TU] . The problem can also be solved as a 
special case of the work in [11]. All of these solutions reduce the decentralized 
control problem to a centralized problem of higher state dimension. 

1.3 Contributions 

The main contribution of this paper is a novel efficient solution to a general class 
of decentralized %2 output feedback model matching problems with communi- 
cation delays. Unlike the existing approaches mentioned above, the method of 
this paper works directly with the original state matrices. In fact, the solution 
is constructed from the classical control and estimation Riccati equations for 
the original system. 

A key assumption made in this paper is that each local measurement even- 
tually reaches each controller. This assumption allows the controller to be de- 
composed into a centralized, but delayed, component and a decentralized finite 
impulse response (FIR) component. Similar decompositions have been exploited 
in [31 [6] [TOl HU [20] . Given the decomposition, the optimal centralized com- 
ponent can be computed as a function of the FIR component by a relatively 
straightforward extension of centralized spectral factorization. It is then shown 
that the optimal FIR component can be found by quadratic programming. 

In the case of a quadratically invariant delay pattern [17) , optimal decentral- 
ized feedback controllers can be computed via the Youla parametrization. When 
the delay pattern is not quadratically invariant, the model matching procedure 
of this paper is still optimal, but the feedback controller recovered by a linear 
fractional transformation is not guaranteed to satisfy the delay constraint. 

1.4 Overview 

The paper is structured as follows. Section [2] defines the general problem stud- 
ied in this paper. Section [3] reviews spectral factorization for centralized H2 
model matching in both undelayed and delayed cases. Extending the delayed 
centralized model matching technique, the decentralized problem is solved in 
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Section [4j Numerical results are given in Section [5] and finally conclusions are 
given in[6j 



2 Problem 

This section introduces the basic notation and the model matching problem 
of interest. Subsection |2.3| describes how common delayed information sharing 
patterns can be cast in the framework of this paper. 

2.1 Preliminaries on 7-L 2 

Let D = {zeC:|z|<l}be the unit disc of complex numbers. A function 
G : (C U {oo}) \ D — > C pxq is in H 2 if it can be expanded as 



oo 1 



where G t € C pxq and Tr(GiGf ) < 00 • Define the conjugate of G by 



G(*)~ = £VG* 



i=0 



" i4 




G 


D 



For a real rational transfer matrix, G 



(G(z/ - Ay 1 B + D)~ = B T [-I-A 



the conjugate is given by 



G T + D T . 



The space is a Hilbert space with inner product defined by 



(G,H) 



1 

2^ 



Tr 



(G(e»'°)ir(^)~)dfl 
^Tr(G^), 



i=0 

where the second equality follows from Parseval's identity. 

If M is a subspace of H2, denote the orthogonal projection onto M by Wm- 

2.2 Formulation 

This subsection introduces the generic problem of interest. Let P be a stable 
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P21 P22 
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Figure 1: The basic feedback loop 

with inputs of dimension pi , p 2 and outputs of dimension q\ , q 2 . Attention will 
be restricted to stable plants for simplicity. Unstable plants can be handled by 
first applying a stabilizing feedback and optimizing the resulting system. 

For the existence of solutions of the appropriate Riccati equations, assume 
that 

• Df 2 Di2 is positive definite, 

• (A,B\) is stabilizablc, 

• D 2 iD 21 is positive definite, 

• (Ci,A) is detectable. 

(Note that stabilizability and detectability follow immediately from the stability 
assumption.) 

For N > 1, define the space of strictly proper finite impulse response (FIR) 
transfer matrices by X — 0jl 1 iC P2X « 2 . Note that \U 2 can be decomposed 
into orthogonal subspaces as 



-H 2 



X< 



,N+1 



n 2 , 



Let 1Z P be the space of proper real rational transfer matrices. Let S C ^1Z P 
be a subspace of the form 



(1) 



where y C iR P2X,j2 C X. 

The decentralized % 2 model matching problem considered in this paper is 
given by 

min Q ||Pn + Pi 2 QP 2 i\\u 2 
s.t. Q eSn±H 2 . 



(2) 
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A feedback controller for the plant can be denned from Q by JC = Q(I + 
P22Q) -1 • If the space S is quadratically invariant Q then Q 6 S if and only if 
JC € 5, 17 . Furthermore, since Q is strictly proper and stable, and P is stable, 
/C must be strictly proper and the closed loop system P 11 +P 12 /C(I— P22^)~ 1 P2i 
must be stable. Furthermore, if Q solves the model matching problem, then JC 
must solve the decentralized optimal control problem: 

min^ ||P n + P 12 JC(I - P 2 2/C)- 1 P 2 i||« 2 , . 

s.t. Ke5. 1 ' 

Note that even if S is not quadratically invariant, the model matching prob- 
lem is still convex, and can be solved by the methods in this paper. In this 
case, however, it could happen that Q(I + P22Q) -1 4- and thus the solution 
to Problem ^ need not lead to a solution of Problem ([3| . 

For technical simplicity controllers in this paper are assumed to be strictly 
proper (that is, in ^1Z P ). The results in this paper can be extended to non- 
strictly proper controllers but more complicated formulas would result. 



2.3 Communication Delay Patterns 

Equation ([T]) can be used to model many delayed information sharing patterns. 
For instance, an infinite-horizon, strictly proper version of the 1-step delayed 
information sharing pattern studied in [TJ [H [3] is captured by the case that 
N = 1 and y corresponds to block diagonal FIR matrices 



y = 



xg 2 i 







JP22X922 



Similarly, for N > 1, the iV-step delay information sharing pattern studied in 
[3 El [10] can be characterized by y of the form 



N 1 



£P21 Xg 2 l 







VP22 XIJ22 



More general team problems with communication delays, such those studied 
in [5J [UJ HS1 HH 120] , can also be captured by Equation . For instance, 
a strictly proper version of the three-player chain problem discussed in [5] is 
described by TV = 2 and 



y C h = 



* 
0*0 
0* 



* * 
* 



(4) 



where, for compactness, * is used to denote a space of appropriately sized real 
matrices. 



1 Thc space S is quadratically invariant if ICP22IC G S for all K, 6 S. 
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3 Centralized Spectral Factorization 



This section gives spectral factorization solutions to centralized model matching 
problem in both delayed and undelayed cases. While the solutions are classical, 
they will be presented in detail, as the decentralized model matching problem 
relies heavily on the terms and ideas in the centralized solutions. 

3.1 Undelayed Case 

The undelayed case corresponds to 



ming \\P U + P12QP21WH2 
s.t. Q G \U-2- 

A necessary condition for optimality is given by 



PyxP\xP%\ + P12P12QP21P21 G ( -'H2 



(5) 



(6) 



A simple argument shows that ("'H2) = \T~^2 > a f ac t that will be used several 
times. 

To derive the optimality condition, let 5 G \T~L 2 be a small perturbation. 
The perturbed norm can be expanded as 

\\Pu+Pi2(Q + 5)P 21 \\l 2 

= (P11 + Pi2(Q + S)P n ,Pu + P«(Q + S)Pai) 

= \\Pu + Pl2QP2l\\u 2 + 

2Re(P~(P 11+ P 12 QP 21 )P~,5)+0(\\6\\ 2 n2 ). 

In particular, if Q is optimal, then the second term must vanish for any 8, and 
it follows that Equation ([6| must hold. 

The following classical lemmas show how to factorize P^Pi 2 and P 2 iP^{ as 
products of causally invertible transfer matrices. 



Lemma 1. Let X be the stabilizing solution of the Riccati equation 

X = CjCi + A T XA - 

(A T XB 2 + ClD 1 2)Q.- l {BlXA + D&Ci), 
where Vl — Df 2 Di 2 + B 2 XB 2 . Define the (linear quadratic regulator) gain by 
K = -ST l {B%XA + Dl 2 Ci). 

The transfer matrix Pi 2 P\ 2 has a left spectral factorization P^ 2 P\ 2 = W£~W£ , 
where Wl is given by 



Wr 



WE 1 



A + B 2 K 


B 2 ' 


K 


I 



rr 1 / 2 , 



A 


-B 2 ' 


K 


I 
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Lemma 2. Let Y be the stabilizing solution of the Riccati equation 

Y = B 1 Bl + AYA T - 

(AYCi + B 1 Dl 1 )^>- 1 {C 2 YA T + D 21 Bf), 

where 4" = -D21-D21 + C2YC2 ■ Define the (Kalman filter) gain by 

L = -{AYCl + B 1 D% 1 )y- 1 . 

The transfer matrix P21-P21 has a right spectral factorization P21-P21 = W^W^ 
where Wr is given by 

W R = 



Wr 1 



1/2 


' A + LC2 


L ' 




c 2 


I 



A 


L ' 


-c 2 


I 



The following standard theorem gives the spectral factorization solution to 
the model matching problem. The presentation is slightly non-standard, in that 
the optimal matrix Qq is defined in terms of an auxiliary matrix T, which is 
used in the delayed and decentralized solutions. 



Theorem 1. Define T by 



T = n 1/2 



' A 


L ' 


K 






^1/2 



(7) 



The optimal solution to the model matching problem of Equation |5p is given by 

Q = -W L TW R . 



Proof. Assume that Equation (|6| holds. Plugging in the spectral factorizations 
shows that 

P? 2 PuP£ + W—W^QW^W— e hit 
Anticausality of W£ and Wr implies that 

wzp^PuP^wz + w^qw^ e l -nt (8) 



Note that W L 1 QW R 1 G \rii- It follows that Equation (|8j) can be set to zero 
by applying the projection operator: 

Pi« a {WlP^PuT^Wr + W^QWr 1 ) 

= 0. (9) 



Let T = Pi^ 2 {W^P^PuP^W^), Equation |9| shows that Q = -W L TW R . 
Furthermore, standard state space manipulations show that T has the form in 
Equation and the proof is complete. □ 
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3.2 Delayed Case 

The delayed case corresponds to the following model matching problem: 

irrmg \\P U + PuQPziWn, 
s.t. Q e -J^H 2 - 



(10) 



An argument analogous to the derivation of Equation ^ shows that a nec- 
essary condition for optimality in the delayed case is 

pmiP?i + P12P12QP21P21 g (-i+i^) . (11) 

As in the undelayed case, a simple argument shows that ( jv+i H2) = z n+i H% . 

Theorem 2. The optimal solution to the delayed model matching problem is 
given by 

Q N = -W L ¥^_ n2 (T)W R . (12) 



Proof. Assume that Q € -hj'H.2 satisfies Equation (11) and thus 



P^PnP^i+W—W^QW^W— G ^Ht, 

wzp^PuP^wz + w^qWk 1 e -^nk, (is) 

where the second line follows from anticausality of W£ and W£ . As in the proof 
of the case with no delays, W£ 1 QW^ 1 € z ^ +1 H.2 and the left side of Equation 



( 13 ) can be set to zero by projection: 

T n 2 {WZPZPuP&WZ) + W£ l QW^ 



Z N + 1 

= 0. 



Furthermore, sillCC jv+i 7^2 CI ~7"^2; it follows that P 1 nj — IP 1 77 7 -P 1 • 

Thus, the projection can be computed in terms of T as 
= -P 1 (T). 

Multiplying on the left and right by Wl and Wr, respectively, completes the 
proof. □ 
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4 Decentralized Model Matching 



This section presents the main results of the paper. Recall that in centralized 
model matching, from Equation ([2]), that Q is constrained to be in the space 
n +1 %2 ffi y~ It follows that without loss of generality, Q can be decomposed as 

Q = U + V 

with U E -^ T rU 2 and V ey. 

Theorem 3. The optimal solution to the decentralized model matching problem 
(Equation ^)) is given by 

Q* = U* + V* 
where V* is the unique minimizer of 

||P* (W I ; 1 VW R 1 )\\ 2 n2 +2(V x {W^VW- 1 ) ,T) (14) 

and 

U*=Q N - W L F. H2 (W£ l V*W^) W R . (15) 



Here Qn is the optimal centralized delayed controller from Theorem^ 
The theorem can be proved by combining the following two lemmas: 

Lemma 3. For any V £ y , the optimal solution to 

minu ||P U + P 12 VP 2 i + Pi 2 UP 2 i\\n 2 
s.t. U £ -hrU 2 



(16) 



is given by 

U(V) = Q N ~ WlF^k, (W£ l VWn l ) W R . (17) 
with optimal cost given by 

\\Pxx + Pi 2 VP 21 + Pi 2 U(V)P 21 \\ 2 n2 
= \\Pii+Pi 2 QnP 2 i\\ 2 u 2 + (18) 

IIP* (WE 1 vw R 1 )\\l i2 + 2(¥ x (we 1 vwe 1 ) ,T) 



Lemma 4. The expression in Equation (14-) has a unique minimum V* which 



can be efficiently computed by quadratic programming. 



Remark 1. Note that Equation (17) implies that the optimal U is always the 



sum of the optimal delayed controller, Qjv, and a correction term that depends 



linearly on V. Furthermore, Equation ( 18 1 shows that optimal decentralized 
cost is the cost of the delayed controller minus benefits gained from choosing V. 
In particular if V — 0, then the delayed cost is recovered. 
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To see how the lemmas prove Theorem [3j assume that U* and V* are opti- 
mal. By optimality, U* must solve Problem (fl6|) with V = V* . Thus Equation 



(15) holds. Furthermore, optimality of V* implies that it must minimize the 
right side of Equation (18 1, which is equivalent to minimizing Equation (14). 
To complete the proof of Theorem |3j the lemmas will now be proved. 



Lemma [H First Equation (17) will be derived, and then the form will be used 
to derive Equation (18). If U solves Problem (16), then, as in the proof of the 
centralized delayed case (Theorem [2]) , a necessary condition for optimality is 
given by 

P12P11P21 + P12P12V P21P21 - 1 -T/-L 

+P^P 12 UP 2i P^ fc " 2 ■ 

Plugging in the spectral factorizations shows that 

p^PuP?! + wrw^vw^w^ 1 

+W7~WT 1 UW T Z 1 W„~ z n + 1 



By anticausality, multiplying on the left and right by W£ and , respectively, 
gives, 



WZPZPnPZWS 



+W7 1 VW„ 1 + WT^WZ 1 



-1 e 



1 



L w yy R 

-lrrw-1 



As in the centralized delayed case, W L 1 UW R 1 € Z J~ +1 H2 and the left side can 
be set to zero by projection: 

F ^+rn 2 (WZP? 2 PuP£WZ) 
= P 1 -it (T) 
= 0. 

Rearranging and multiplying on the left and right by Wl and Wr, gives the 
form of U: 



-Wr 



{W^VWn 1 ) W r 

-It 



= Q N - W L P_._ n2 (W£ l VW^) Wr, 

where Qn is the solution from Theorem [2j Thus Equation (17) has been proved. 
Now Equation ( 18 ) must be proved. The full controller, Q, is given by 



Q = Qn ~ W L W_i_ H2 (W^VWn 1 ) W R + V. 



(19) 
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The second and third terms can be expressed as 

~ w ^ p ^^ (w^vw* 1 ) w R + v 



(20) 



W L (w^VWr 1 - P_^ 2 (W^VWx 1 ] 



'^n 2 ) (W^VWn 1 )) W R 
= W L F X (W£ 1 VW^ 1 )W R 



«2 



Note that the third equality follows since ¥x 
by 

G 

the controller Q can now be written as 

Q = Qn + WrGW l . 
Plugging Equation (22) into \\P11 + -P12Qf21.il ^ gives a quadratic function 



1 n, . Defining G 

fr+i H 2 b 

(21) 
(22) 



of G: 



PuQPziWua 

= \\Pii+Pi2{Qn + W l GWr)P 21 \\ 2 H2 

= \\P11 + Pi2Q N P2i\\ 2 n 2 + \\Pi2W L GW R P 21 \\ 2 U2 

+2(P 11 +P 12 Q n P 21 ,P 12 W l GW r P 2 i), (23) 

where the third term is real because Qn and G must have real coefficients. 
The second term of Equation ( 23 1 can be simplified as 

(P 12 W L GW R P 21 , p 12 w l gw r p 21 ) 
= {WlPi 2 Pi2W l GWrP 21 P 21 Wr,G) 
= (WlW^W^WlGWrW^W^Wr^G) 
= (G,G) 



(24) 



Similarly, the third term of Equation ( 23 ) can be simplified as 

(fn + fi 2 Qdf 2 i, Pi2W l GWrP 21 ) 
= (WZPr 2 PnP 21 WR,G) 

+ (W£Pi 2 Pi 2 Q n P 2 iP 21 Wr,G) 
= (T, G) + (WlW—W^QnW^W—Wr, G) 
= (T,G) + (W I ; 1 Q N W R 1 1 G) 

= (T, G) . (25) 

The fourth equality follows because G € X and W^QnW^ 1 € z n+i 'H 2 , which 
are orthogonal spaces. Combining Equation (24) and (25) with Equation (23) 
proves that the cost can be decomposed as 

||Pii+Pi 2 QP2i|rL 
= ||fn + fi 2 Qjvf 2 i||L + ||G||L + 2(G,T). 
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Substituting the definition of G (Equation plj)), proves Equation (18) and the 
proof of the lemma is complete. □ 



Lemma^4\ Recalling Equation (21 1, G can be expanded as an FIR transfer ma- 
trix 



G 



N 1 



Now the coefficients of G will be computed in terms of V, W^ 1 , and W^ 1 . For 
notional simplicity, let H — W^ 1 and J — Wr . The matrices H and J can be 
expanded as 

Since V € y C X it can be expanded as V — YliLi ^ follows that Gi can 

be written as a linear function of V: 



Gi — ^ HjVkJi- 



(26) 



j,l>0, k>l 
j + k+l=i 



Similar to H and J, T can be expanded as 

^ z % z^ z l 

i=l i=0 

The expansions of G and T can now be used to express Equation ( 14 ) in a 
form suitable for numerical evaluation: 



? x (WE'VWn 1 ) \\l 2 + 2(V X {W^VW^) ,T) 
= \\Gf U2 +2{G,T) 

N N 

= ^Tr(G i Gf)+2^Tr(G l i; T ). 

i=l i=l 



(27) 



Note that Equations ( 26 1 and ( 27 1 can be used to define a convex quadratic 
program in V. If the quadratic form $^ =1 Tr (GiGf) is positive definite in 
V, then the right side of Equation ( |27[ ) must have a unique minimum which is 
efficiently computable. 

The proof can thus be completed by showing that ||G||^ — implies that 
V = 0. Assume that ||Cr||f/ = 0. By the positive dcfinitcness of norms, it must 
be that G = 0. Equations (20) and (21) imply that 



W L GW R = V- W L ¥^_ n2 (W^VWr 1 ) W r , 
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Figure 2: The graph depicts the the communication structure of the three- 
player chain problem. Players 1 and 3 pass information to player 2 after a 
single step delay while player 2 passes information to players 1 and 3 after a 
single step of delay. 

and thus, by projection, 

V = V x (W L GW R ) . 
Therefore, G = implies that V — and the proof is complete. □ 



5 Numerical Examples 

The results in this paper demonstrate that decentralized model matching with 
communication delays can be efficiently solved by in terms of the original state 
matrices. In particular, aside from centralized Riccati equations, the only nu- 
merical computation required is a quadratic program specified by Equations 



(26) and (27 1. This section demonstrates the method with a few examples. 



5.1 The Chain Problem 

The three-player chain structure, [5], is a delayed information sharing pattern 
specified by the graph in Figure [2] In the frequency domain, the information 
structure is represented by the constraint JC G Sch — 3^Ch © ^s^pi where J^ch 
is given in Equation Q. Consider the plant specified by 
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<3 
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o 3 
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x3 , 


o 3 


x3 



For comparison purposes, the optimal H.i norm was computed using model 
matching from this paper, the LMI method of [HI US], and the vectorization 
method of [17] ■ In all three cases the norm was found to be 2.1082. In contrast, 
the centralized controller, Qo, gives a norm of 2.0853, while the delayed con- 
troller, Q 2 , gives a norm of 2.1780. This is to be expected, since the controller 
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Undelayed 
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Diagonal 
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Pure Delay 
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Delay (N) 



100 



Figure 3: This plot shows the closed-loop norm for Q^ ri , Quu Qhow an d 
Qn (the pure delay case). For a given N, the controllers with fewer sparsity 
constraints give rise to lower norms. As N increases, all of the norms increase 
monotonically since the controllers have access to less information. The dotted 
lines correspond to the optimal norms for sparsity structures given in Equation 
(28). For pure delay, Qn 



as N — > oo, and thus the norm approaches the 



open-loop value. 



obeying the three-player chain structure is more constrained than Q , but less 
constrained than Q 2 : js%2 C (S C h H \l-L2) C \%2- 



5.2 Increasing Delays 

Consider the plant with matrices given by 
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c = 
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For N > 1, let Q^, Qui: an d Ql ovj solve the decentralized model matching 



problem, Equation ([2]), with the form 



^Tri 


= u&i 


V N 


Qui 


= D& + 


yN 
v Ui ' 


t Low 


— '-'Low 


i v Low 



Here U&,U&, e and 
with sparsity structure given by 



^Low are FIR transfer matrices 



Vn 



N 
Tri 



T '1\ 

v Ui 



^Low 



E 1 

i=l 
N 1 

E 1 

i=l 

N 1 

E 1 



* 

* * 

* 0' 

* 

0' 

* 



The resulting norms are plotted in Figure ([3]). 

As N — > oo, the resulting controllers appear to approach optimal sparse 
controllers 



Qui 



Q 



oo 
Low 



1% 





1 nj Inj 

-H 2 -H.2 







o \n 2 







o \n 2 _ 





(28) 



which can be computed by the vectorization technique from |17j . Evidence for 
the convergence is shown by the fact that the norms limit to the values computed 
for the sparse controllers (Figure [3| . 
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6 Conclusion 



This paper derives a novel solution for a class of output feedback H2 model 
matching problems with communication delays. To find the optimal solution, 
the controller is decomposed into orthogonal components, both of which are 
easily computable. In particular, centralized delayed controllers that optimally 
correct for the FIR component are computed by spectral factorization. Then, 
the problem is then reduced to optimization over the FIR component. 

The results of this paper indicate that the optimal control can be computed 
in terms of the centralized Riccati equations for the system. Existing time- 
domain methods, such as [TTJ [T51 [T5] , work with state variables that have been 
augmented to include memory vectors required by the various controllers. The 
optimal controllers are then constructed based on centralized solutions to the 
augmented-state problems. It would be interesting to see if these alternative 
constructions can be mapped onto one another. In particular, the augmented- 
state solutions could lend insight into the computation of the FIR terms, while 
the method of this paper might be used to construct solutions to the augmented- 
state problems in terms of optimal controllers for the original centralized system. 
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